APPARATUS AND METHOD FOR WATERMARK EMBEDDING AND DETECTION 
USING LINEAR PREDICTION ANALYSIS 

Field of the Invention 

5 

The present invention relates to an apparatus and method 
for a watermark embedding and detection using a linear 
prediction analysis, and a record medium capable of being read 
through a computer to realize the inventive method; and, more 

10 particularly, to an apparatus and method for a watermark 
embedding and detection using a linear prediction analysis, 
and a record medium capable of being read through a computer 
having a writing of a program to realize the inventive method, 
in which a watermark used for a copyright information 

15 protection and management of a digital signal can be 
efficiently embedded, a quality of the digital signal does not 
drop even after the imbedding of a watermark signal by using a 
perception model based on a hearing characteristic of a human 
being, and further the watermark signal containing the 

20 copyright information can be stably detected even though 
various attacks using an optional method are applied to the 
digital signal having the imbedding of the watermark. 

Prior Art of the Invention 

25 

Recently, a rapid development in a computer use and a 
computer network such as Internet generally brings about the 
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use and spread of multimedia data. In such multimedia data, 
but, another original is made owing to attributes of digital 
in case that multimedia data is copied, thus anyone can obtain 
such digital data through an easy illegal reproduction. With 
5 such reasons it is caused a requirement for protecting the 
copyright and the ownership of an author who produces 
multimedia contents and for preventing the illegal 
reproduction. 

A data protection technique most representative and 

10 widely used up to the present is the method of encoding data, 
and has merits that an approach to the data is impossible if a 
user does not know its codes. In this technique, meantime, 
after the codes are first decoded, there is a problem that the 
data may be illegally copied and distributed without any 

15 limitation. Meanwhile, a digital watermark is a kind of 
digital signature appended to an original signal so as to 
enable to be detected or extracted after an embedding into the 
digital data, and is based on the method for protecting the 
copyright and the ownership information of the digital data 

20 even after decoding. 

However, in methods for -protecting the copyrights of the 
digital data through a use of watermarks announced by this 
time, there are many cases that an audio quality falls after 
the embedding of the watermark. Further, in case that a signal 

25 process optional attack such as a compression or filtering is 
applied to an audio signal having an imbedding of the 
watermark, there is a problem that the watermark can not be 
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extracted. Particularly, the existing announced watermark 
embedding and detecting methods are mostly based on a 
diffusion spectrum system used in a code division multiple 
access (CDMA) communication. In the existing watermarking 

5 method using such diffusion spectrum system, in case that' an 
attack on a time base such as a linear speed change, a pitch- 
invariant time-scale modification, and a wow and flutter etc. 
is applied, it is caused a problem the a detection of the 
watermark is impossible. This problem is caused because in the 

10 system based on the existing diffusion spectrum system, a 
pseudo-noise sequence is used as a watermark signal and a 
synchronization between the pseudo-noise sequence and an audio 
signal having an imbedding of the watermark is not matched in 
a watermark detecting part in case that the attack on the time 

15 base is applied thereto. 

Summary of the Invention 

Therefore, it is an object of the present invention to 
20 provide an apparatus and method for a watermark embedding and 
detection using a linear prediction analysis, and a record 
medium capable of being read through a computer having a 
writing of a program to realize the inventive method, in which 
not only a quality of a signal does not fall, even after an 
25 imbedding of a watermark by using a signal based on a changed 
shape of an original signal through a use of a linear 
prediction analysis, through a use of a watermark signal to be 
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imbedded in a digital signal, but also a watermark signal 
containing copyright information can be detected even though 
an optional attack is applied thereto. 

In accordance with the present invention for achieving 
5 the objects, the watermark imbedding apparatus using a linear 
prediction analysis includes a linear prediction analyzing 
unit for receiving an original signal and detecting a 
prediction coefficient predetermined through the linear 
prediction analysis; a delay unit for receiving the original 

10 signal and delaying it by a predetermined time; a linear 
prediction analysis filtering unit for filtering the signal 
delayed in the delay unit by using the prediction coefficient 
detected in the linear prediction analyzing unit; a frequency 
area converting unit for converting the signal outputted from 

15 the linear prediction analysis filtering unit into a frequency 
area signal; a psychological acoustic modeling unit for 
receiving the original signal and gaining a masking threshold 
by employing a psychological acoustic model; a time-varying 
adaptation filtering unit for performing a control so that the 

20 signal outputted from the frequency area converting unit may 
have a magnitude approximate to a magnitude of the masking 
threshold gained in the psychological acoustic modeling unit; 
a time area converting unit for changing the signal outputted 
from the time-varying adaptation filtering unit to a time area 

25 signal; an error correction coding unit for receiving 
copyright information and providing an error correction 
function; a code generating unit for providing a code to the 
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time area signal outputted from the time area converting unit 
in response to the signal outputted from the error correction 
coding unit; and a computing unit for adding and deducting the 
signal having the code provided from the code generating unit 
5 to/from the original signal in response to a corresponding 
code . 

In another apparatus of the present invention, the 
watermark detecting apparatus using the linear prediction 
analysis is composed of a linear prediction analyzing unit for 

10 receiving a signal having an imbedding of a watermark and 
outputting a prediction coefficient predetermined through the 
linear prediction analysis; a linear prediction analysis 
filtering unit for filtering the signal having the imbedding 
of the watermark by using the prediction coefficient extracted 

15 from the linear prediction analyzing unit; an autocorrelation 
acquiring unit for receiving a filtered value outputted from 
the linear prediction analysis filtering unit and gaining an 
autocorrelation; a code detecting unit for detecting a code of 
a correlation outputted from the autocorrelation acquiring 

20 unit; and an error correction decoding unit for performing an 
error correction decoding according to a code detection result 
value outputted from the code detecting unit and extracting a 
watermark signal. 

In one method of the present invention, the watermark 

25 imbedding method applied to the watermark imbedding apparatus 
using the linear prediction analysis includes a first step of 
receiving an original signal, and detecting a prediction 
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coefficient predetermined through the linear prediction 
analysis, and delaying it by a predetermined time, and gaining 
a masking threshold by employing a psychological acoustic 
model; a second step of filtering the delayed audio signal by 

5 using the detected prediction coefficient; a third step of 
converting a value filtered in the second step into a 
frequency area signal; a fourth step of AR (Auto-regressive) - 
filtering the frequency area signal by using the masking 
threshold; a fifth step of converting the signal filtered in 

10 the fourth step into a time area signal; a sixth step of 
generating an error correction code having copyright 
information and an error correction function and providing a 
code to the time area signal according to the error correction 
code; and a seventh step of adding and deducting the time area 

15 signal to/from the original signal according to the provided 
code, and producing a signal having an imbedding of a 
watermark. 

In another method of the present invention, the 
watermark detecting method applied to the watermark detecting 

20 apparatus using the linear prediction analysis includes a 
first step of receiving a signal having ah imbedding of a 
watermark, and detecting a prediction coefficient 
predetermined through the linear prediction analysis; a second 
step of filtering the signal having the imbedding of watermark 

25 by using the detected prediction coefficient; a third step of 
measuring an autocorrelation of the filtered signal; a fourth 
step of detecting a code for the measured correlation; and a 
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fifth step of performing an error correction decoding by using 
the code detection result, and extracting a watermark signal. 

While, in a watermark imbedding apparatus having a 
processor based on a large capacitance, in the record medium 
5 capable of being read through a computer having a writing of a 
program, the program contains a first function of receiving an 
original signal, and detecting a prediction coefficient 
predetermined through a linear prediction analysis, and 
delaying it by a predetermined time, and gaining a masking 
10 threshold by employing a psychological acoustic model; a 
second function of filtering the delayed audio signal by using 
the detected prediction coefficient; a third function of 
converting a value filtered in the second function into a 
frequency area signal; a fourth function of AR (Auto- 
15 regressive) -filtering the frequency area signal by using the 
masking threshold; a fifth function of converting the signal 
filtered in the fourth function into a time area signal; a 
sixth function of generating an error correction code having 
copyright information and an error correction function and 
20 providing a code to the time area signal according to the 
error correction code; and a. seventh function of adding and 
deducting the time area signal to/from the original signal 
according to the provided code, and producing a signal having 
an imbedding of a watermark. 
25 In addition, in a watermark detecting apparatus having a 

processor based on a large capacitance and in the record 
medium capable of being read through a computer having a 
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writing of a program, the program contains a first function of 
receiving a signal having an imbedding of a watermark, and 
detecting a prediction coefficient predetermined through a 
linear prediction analysis; a second function of filtering the 
signal having the imbedding of watermark by using the detected 
prediction coefficient; a third function of measuring an 
autocorrelation of the filtered signal; a fourth function of 
detecting a code for the measured correlation; and a fifth 
function of performing an error correction decoding by using 
the code detection result, and extracting a watermark signal. 

Brief Description of the Drawings 

The above and other objects and features of the instant 
invention will become apparent from the following description 
of preferred embodiments taken in conjunction with the 
accompanying drawings, in which: 

Fig. 1 is a block diagram of one embodiment for a 
watermark imbedding/detecting apparatus in accordance with the 
present invention; 

Fig. 2 illustrates a detailed block diagram of one 
embodiment for the audio watermark imbedding part in the 
present invention; 

Fig. 3 depicts a detailed block diagram of one 
embodiment for the inventive watermark detecting part; 

Fig. 4 is a flowchart of one embodiment for the 
inventive watermark imbedding method; and 



Fig. 5 is a flowchart of one embodiment for the 
inventive watermark detecting method. 

Preferred Embodiment of the Invention 

5 

Hereinafter, preferred embodiments of the present 
invention will be described in detail with reference to the 
accompanying drawings . 

Fig. 1 is a block diagram of one embodiment for a 

10 watermark imbedding/detecting apparatus in accordance with the 
present invention. 

As shown in Fig. 1, the inventive watermark 
imbedding/detecting apparatus includes an audio watermark 
imbedding part 100 for receiving an audio signal 101 and 

15 copyright information 102 of the audio signal and imbedding a 
watermark signal in the audio signal 101; and a watermark 
detecting part 200 for receiving the audio signal having the 
imbedding of the watermark signal in the audio watermark 
imbedding part 100 and detecting the watermark signal as the 

20 copyright information. 

In the audio signal 101 inputted to the audio watermark 
imbedding part 100, audio copyright information data 102 is 
imbedded repeatedly with a constant time interval. A quantity 
of such imbedded data can be optionally controlled. In other 

25 words, the quantity of the imbedded information can . be 
controlled by performing a control for a size of an audio 
signal section into which the copyright information 102 will 
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be imbedded. Also, information to be imbedded in the audio 
signal 101 is valid for all the copyright information based on 
optional shapes such as image, video, audio, sound and text 
etc . 

5 Fig. 2 is a detailed block diagram of one embodiment for 

the audio watermark imbedding part in the present invention; 

As shown in Fig. 2, the audio watermark imbedding part 
includes a linear prediction analyzing unit 201 for receiving 
an audio signal 211 and detecting a prediction coefficient 

10 predetermined through the linear prediction analysis; a 
delayer 202 for receiving the audio signal 211 and delaying it 
by a predetermined time, and sending the delayed signal to a 
linear prediction analysis filtering unit 203; the linear 
prediction analysis filtering unit 203 for filtering the audio 

15 signal delayed in the delayer 2 02 by using the prediction 
coefficient detected in the linear prediction analyzing unit 
2 01; a high speed furrier converting unit 2 04 for converting 
the signal outputted from the linear prediction analysis 
filtering unit 203 into a frequency area signal; ■ a 

20 psychological acoustic modeling unit 205 for receiving the 
audio signal 211 and gaining a masking threshold by employing 
a psychological acoustic model; a time-varying adaptation 
filtering unit 206 for performing a control so that the signal 
outputted from the high speed furrier converting unit 2 04 may 

25 have a magnitude approximate to a magnitude of the masking 
threshold gained in the psychological acoustic modeling unit 
2 05; a high speed furrier inverse-converting unit 2 07 for 
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changing the signal outputted . f rom the time-varying adaptation 
filtering unit 206 to a time area signal; an error correction 
coding unit 2 08 for providing an error correction function to 
copyright information 213; a code generating unit 209 for 

5 providing a code to the time area signal outputted from the 
high speed furrier inverse-converting unit 207 according to 
the signal outputted from the error correction coding unit 
2 08; and an adder 210 for adding and deducting the signal 
having the code provided from the code generating unit 209 

10 to/from the input audio signal 211 in response to a 
corresponding code. 

Operations of the watermark imbedding part are described 
more in detail, as follows. 

First, in the linear prediction analyzing unit 201 

15 receiving the audio signal 211, prediction coefficients of the 

P number, a u a 2, a ?» —> a P / predetermined through the linear 
prediction analysis are detected. The prediction coefficient P 
may become different according to a state of the inputted 
audio and is decided between 5 and 50. 
20 That is, the linear prediction analyzing unit 201 

analyzes the audio signal 211 inputted to a portion performing 
the linear prediction analysis, and generates the prediction 

coefficients a u a 2, a ^ a P capable of predicting the inputted 
audio signal 211. At this time, a specific spectrum of the 
25 inputted audio signal can be predicted by using the generated 
prediction coefficient. 
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The delayer 202 receives an original audio signal and 
delays it by a predetermined time ^ , and after that, sends 
the delayed signal to the linear prediction analysis filtering 
unit 203. Herewith, the delay x becomes a key value in a 
5 watermark detection. 

The linear prediction analysis filtering unit 203 

performs a filtering for the audio signal delayed by ^ in the 
delayer 202 by using the prediction coefficients of the P 
number generated in the linear prediction analyzing unit 201. 

10 In other words, the linear prediction analysis filtering unit 
203 filters the inputted audio signal 211 by using the 
prediction coefficient capable of predicting the audio 
spectrum, and outputs a residual signal gotten by removing the 
audio specific spectrum therefrom, or a filtered value 

15 provided as an error signal. 

The residual signal as an output of the linear 
prediction analysis filtering unit 203 is converted into a 
frequency area signal through the high-speed furrier 
converting unit 204, 

20 Meantime, the psychological acoustic model unit 205 

receives the original audio signal 211 and gains a masking 
threshold by employing a psychological acoustic model. This 
masking threshold indicates a threshold capable of sensing 
original sound in the frequency area. Thus, even though signal 

25 components under the masking threshold is added to the 
original sound of the audio, the added sound can not be sensed 
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Such masking threshold can be obtained by using the 
psychological acoustic model used in an MPEG (Moving Picture 
Expert Group) audio coding system. 

The time-varying adaptation filtering unit 206 filters a 
5 signal passed through the high-speed furrier converting unit 
204 by utilizing the masking threshold inputted from the 
psychological acoustic model unit 205. That is, in the time- 
varying adaptation filtering unit 206, a characteristic of a 
filter is changed differently by a characteristic of audio 

10 changed according to a time, and the time-varying adaptation 
filtering unit 206 performs a control so that the signal 
outputted from the high speed furrier converting unit 2 04 may 
have a magnitude approximate to a magnitude of the masking 
threshold gotten from the psychological acoustic model unit 

15 205. 

Herewith, in processing the audio signals 211, the audio 
signals 211 are sequentially processed by a unit of a frame 
having a constant magnitude, and at this time, respective 
different masking thresholds every respective frame are gained 

20 That is, since the masking threshold changed every frame 
becomes different, it is controlled every frame so that the 
signal outputted from the high speed furrier converting unit 
2 04 may have a magnitude approximate to a magnitude of the 
masking threshold obtained in the psychological acoustic model 

25 unit 205. In the time-varying adaptation filtering unit 206, 
an AR (Auto-regressive) filter is made on the basis of the 
obtained masking threshold, after that, the signal outputted 
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from the high speed furrier converting unit 204 is passed 
through the AR filter so as to have the magnitude approximate 
to the masking threshold. 

An output signal from the time-varying adaptation 

5 filtering unit 206 is changed to a signal of a time area 
through the high speed furrier inverse-converting unit 2 07. 

Meanwhile, the copyright information 213 is inputted to 
the code generating unit 2 09 through the error correction code 
unit 208. The error correction code unit 208 provides an error 

10 correction function capable of correcting an error causable in 
detecting the watermark signal. The code generating unit 209 
performs a function for giving a code to the signal passed 
through the high speed furrier inverse-converting unit 207 and 
changed to the time area signal, and the code generating unit 

15 209 gives a minus code in case an output signal of the error 
correction code unit 208 is 0, and gives a plus code in a case 
of 1. That is, in case that the minus code is given by the 
code generating unit 209, the signal passed through the high 
speed furrier inverse-converting unit 207 is omitted from the 

20 original audio signal, and in case that the plus code is given 
from the code generating unit 2 09, the signal passed through 
the high speed furrier inverse-converting unit 207 is added to 
the original audio signal, to thereby finally produce an audio 
signal 212 in which the watermark signal containing copyright 

25 information 213 is imbedded. 

That is to say, the watermark signal to be finally 
imbedded in the original audio is the signal gained by 
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delaying by ^ the original audio signal from which the audio 
spectrum is eliminated through the linear prediction analysis. 

Fig. 3 is a detailed block diagram of one embodiment for 
the inventive watermark detecting part. 
5 As shown in Fig. 3, the inventive watermark detecting 

part a linear prediction analyzing unit 301 for receiving an 
audio signal 300 having an imbedding of the watermark and 
detecting a prediction coefficient predetermined through the 
linear prediction analysis; a linear prediction analysis 

10 filtering unit 302 for filtering the audio signal 300 having 
the imbedding of the watermark by using the prediction 
coefficient extracted from the linear prediction analyzing 
unit 301; a short-section autocorrelation unit 303 for 
receiving a filtered value outputted from the linear 

15 prediction analysis filtering unit 302 and computing an 
autocorrelation; a code detecting unit 304 for detecting a 
code of a correlation outputted from the short-section 
autocorrelation unit 303; and an error correction decoding 
unit 305 for receiving the code detection result value 

20 outputted from the code detecting unit 304, performing an 
error correction decoding, and extracting a watermark signal. 

Operation procedures in the watermark detecting part are 
described more in detail, as follows. 

The linear prediction analyzing unit 301 receives the 

25 audio signal 300 having the imbedding of the watermark, as its 
input, and performs a linear prediction analysis for the audio 
signal 300 having the imbedding of the watermark, and then, 
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generates prediction coefficients ai ' c?2 ' a ^ "' ' Gp capable of 
predicting the inputted audio signal 300 having the imbedding 
of the watermark, and sends them to the linear prediction 
analysis filtering unit 302. 
5 The linear prediction analysis filtering unit 302 

performs the same operation as the linear prediction analysis 
filtering unit 203 of the watermark imbedding part 100, to 
thus output a residual signal gotten by eliminating spectrum 
of audio having an imbedding of the watermark or a filtered 
10 value provided as an error signal. 

This outputted residual signal is gained by a 
combination of a residual signal of the original audio signal 
and a residual signal of the original audio signal delayed by 

^ . The output signal having such characteristic is inputted 

15 to a short-section autocorrelation unit 303. 

The short-section autocorrelation unit 303 computes 
autocorrelations of the inputted signal. As above-mentioned, 
since the signal inputted to 303 is the signal gotten by the 
combination of the residual signal of the original audio 

20 signal and the residual signal of the original audio signal 
delayed by ^ , when the autocorrelation is measured for this 
signal, the highest correlation is provided at a starting 
point and a position of a: . 

The code detecting unit 304 checks a code for a 

25 correlation at the ^ position measured in the short-section 
autocorrelation unit 303, and in case the code is plus, is 
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outputted, and in case the code is minus, x 0' is outputted. 
Such result is sent to an error correlation decoding unit 305. 

The error correlation decoding unit 305 receives bit 
information of the inputted x l' or x 0' , and performs an error 
5 correlation decoding for it, and restores it in case that the 
error occurs . 

An output of the error correlation decoding unit 305 
becomes final copyright information 306. 

Fig. 4 is a flowchart of one embodiment for the 
10 inventive watermark imbedding method. 

As shown in Fig. 4, first, in a step 4 01, an audio 
signal is received and a prediction coefficient predetermined 
through the linear prediction analysis is detected in a step 
402. The audio signal is received and is delayed by a 
15 predetermined time, and the delayed audio signal is filtered 
by using the detected prediction coefficient, to thus gain a 
residual signal gotten by eliminating the audio peculiar 
spectrum or the filtered value provided as the error signal in 
a step 4 03, and then the filtered value is converted into a 
20 freguency area signal in a step 404. 

Next, the masking threshold is obtained by applying the 
psychological acoustic model to the audio signal in a step 405, 
and the frequency area signal is AR (Auto-regressive) -filtered 
by using the masking threshold in a step 406. The filtered 
25 signal is converted into a time area signal in a step 407. 

Subsequently, the error correction code having the 
copyright information and the error correction function is 
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generated in a step 408, and the code is given to the time 
area signal according to the error correction code in a step 
409. Herewith, in case that a signal of the error correction 
code is *0', a minus code is given, and in a case of , a 
5 plus code is given. 

An audio signal having an imbedding of the watermark is 
produced by adding up or deducting the original audio signal 
and the time area signal having the code, in a step 411. 

Fig. 5 is a flowchart of one embodiment for the 

10 inventive watermark detecting method. 

As shown in Fig. 5, - the audio signal having the 
imbedding of the watermark is inputted in a step 501. Then, 
the prediction coefficient predetermined through the linear 
prediction analysis is extracted in a step 502, and it' is 

15 gained the residual signal gotten by eliminating the spectrum 
of the audio having the imbedding of the watermark or the 
filtered value provided as the error signal by using the 
prediction coefficient, in a step 503. Herewith, the outputted 
residual signal is gotten by combining the residual signal of 

20 the original audio signal and the residual signal of the 
original audio signal delayed by " c . 

Next, it is measured the autocorrelation of the signal 
gotten by combining the residual signal of the filtered 
original audio signal and the" residual signal of the original 

25 audio signal delayed by , and a code for the correlation at 
the measured ~* position is detected. If the code is plus, *1' 
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is output ted, and if the code is minus, A 0' is outputted, in a 
step 505. The error correction decoding is performed by using 
the code detection result in a step 506, and the copyright 
information is extracted in a step 507. 
5 Such described inventive method is embodied by a program, 

and can be stored as a type capable of being read through a 
computer at a record medium such as CDROM, RAM, ROM, floppy 
disk, hard disk and optical-magnetic disk etc. 

As afore-mentioned, in accordance with the present 

10 invention, the inventive technique can be used as the kernel 
of technique for the copyright protection of a digital signal, 
a watermark can be imbedded without deteriorating a quality of 
the digital signal, and a watermark signal can be stably 
extracted even though a voluntary attack such as a compression, 

15 a time base attack and a filtering etc. is delivered. 

In addition, the inventive technique can be utilized in 
an authentication for clarifying an existence or inexistence 
for a manipulation or a change of the digital signal, and can 
be also used in a usage control capable of controlling, by a 

20 use of watermark, the number of reproductions permissible when 
digital data is played through a portable device or other 
equipment. Additionally, there is an effect of performing a 
transmission by using, as the watermark, additional data 
instead of copyright information. 

25 It will be apparent to those skilled in the art that 

various modifications and variations can be made in the 
present invention without deviating from the spirit or scope 
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of the invention. Thus, it is intended that the present 
invention cover the modifications and variations of this 
invention provided they come within the scope of the appended 
claims and their equivalents. 
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